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' ^ • ABSTRACT ■ - ' , . ' ■ . 

The .papei; attempts to show how the Merging field of Cognitive Science can have 
a major impact on practical education/ In particular it provides ati overview 
of two projects at Bolt, Beranek & Newman the work on Socratic tutoring by 
Colling and Stevens and the. work on diagnosing student *s misconceptions in { 
arithmetic by Brown and Burton, These two projects ar^ cited as examples ' . 
of how the techniques of Cognitive Science ma|ea it possible ta analyze teach 
'ing and leamiiig in genuinely novel ways. 



^ EXPLICATING' THE TACIT KNOWLEDGE * IN- rEACHlriG & LEARNING 

.Allan Coll ins " /•/ 

• - -c ■ ■ 

The question I decided to address ts whether .Cognitive 
Science has anything new to say about education, given that some 
Qf the' worl d ' s best minds have been thinkinig about education 
for thousands of years. ^ The .answer I think is ye^s ; Cognitive 



/ Science provides a set of thedreti cal ^ formal isms' and analysis 
. ' ' ' ^; ■ " 

tec^ai flues that can 'be us,ed to study teaching and learning of 

topics like math and sciences in a genuinely novel- way. My ' 



plan is; to .|stit)w haw'- thi s is possible with two case studies 



f 1 rs:t I * wijl outVfae some work St^ens and I ( Col fn' ns , ' 1 977 ; 

^ Stevens & Collins, 1977 ; Stevens, Go! din & Coll i ns n. press ) 

* ■ . ' ■ " . ' ' . ■ ■' ■ 

lyfv.ei done .on tutoring b^^.the Socratic metJiodi and second. I will 

de,s^Ti)e work of, Brown & Burton (1978) on diagnosing students.' 

" I ^. , - ' ^ ' ■ ■ ' ' ' ■ ' 

procedural! er'p^rs in arithmetic. Th-ese are^ only e^xamples of,t.h^ 

^kind 9f, analyses possible. ' .-^"^ : / ' • \ 

- In:* our work on Socratic tutoring, we analysed dial oguejs^ by - 
a number o'f tutors teaching diVfer^ht 'subjects (medi c i ne 'c-do-"" 
graphy^ etc.) using the Socratic me?t»od. The Socrati c method is 

_made.up of a variety of individual strategi es • ^j^ese stnategi es 
involve en^trapping the student 'i nto- mi stakes of; .different kindsi. 

'confronting him wi th- -counter^xampTes , forcing .him to^ make precj-ic- 
tions, "et^:. Generally the metJ:rod requires the stud.ent to derive 
general principles from specific cases, a-pd learn to usV^^Jrese 



r 



principles to make pre'dict^'pns about n.ew cases. • 



FRir 



_ 1 ngi :t.he. rod u.c t ion,, r ule .formaT- i sm .de v.e-l.G.p.ed.. by. N.ew.e.l.l._ & . 

-•Simon '(^9720^ tt was possible'' to characterize the different stra- 
tegies tutors use in terms.' of rules of t+ie form* "when in situa- 
tion X, do Y."\ -We can gi.ve a few e^xamples' to show what' these 
ru'les look like: , - - * ... 

. _ Rule 1: Form a general rule for air i nsuffi ci ent, factor . : 

(1) the -student gives as ;dn ''expl anat i on -'one or more fa-ctors that 

are not sufficient, \ ' ' ' - ' , ; • - ' 

th-en ' ^ ^' ./ " '\< ' y- . ' ^ ' * . ^ 

(2y formulate a. general \:flul era'^s-^erting that the^^factor given is 

sufficient and^ask the s^tuden^ if the rule is true'. 

^ . ■ : ^ / .1. - .... ■ ; 

Example: -^^^the student: gi ves water as the reason they grow rice 
. in . Ctii na , 'ask him "Do you t^hink any. place with, enough water can 
grow rice?"^ *^ • • . . . ' • • ' 

Rul,e'2: Pick a counterexample , for an insufficient factor. 
(1) the s.tudefit g.ives a^ a"n explariation one or mor^ factors that , 



\ are not 'suf f i ci ent , or ' . ' ^ v 

(2) agrees to -the general rule in'RuTe 1,^ - 
/ ' the^ ' . / ' ' ^ ^ , , ^ ' 

(3) L*picJ<: a counterexample that has the right value of the ^factor ( s ) 

• • • ' \ ' 

^ given, but the wrong -value of the dependent variable, and"" 



'■.(4.). ask what the value of tHfe dependent variable is for tiiat case, 
-."or (^) ask why the casual dependence does not hold for that case. 

ERIC . . .2 ^ ^ , . - 
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Example: If la studen t, ,gi ves water" as the reason they grow rice 
in China or agrees that any place ^fTtlT^en o u g h water-can grow rice, 
l^pick a place like Ireland where there is enough water and ask, 
"Do they grow ■ rice .i n Ireland?" o-r "Why dan't they grow rice in 



^ Ireland?" - - 

Rule, 3: Question a predi cti on made without enough i nf or-mat'i on r 

If , ' , - ' , 

(1) a student makes a prediction as to th-e valu^ of the depen- . , 
dent variab-le on the basis of s'ome feet of factors, and" 

(2) there isjanother vsalue consistent with that set of factors,. 



then , J . ' ^ ... J 

(3) ask the* jStudent why not the other val ual" . 



^Example:^ Lfi; the. student predicts they grow^ wheat in Nigeria be- 

cause it is [fertile and warm, ask him why not rice. ' . 

• ■(.-■* ' 

*' WHile:in pne sense the Socra.tic method is a single approach 



3 ^ 



/ 



tha:t i n vol ves ^ teachi ng the-studeht to reason from cases, in 
another senise it is made zap . of ^:a variety of. these specific stra* 
tegies thati^ goo(^* teachers hi^t u'p'on in the' course of their teacH- 
ing. Some.rhit upon one set, some upon' another, .though there is 
usually so^e overlap.' There i s ^^1 1'ttl e need for teachers to 
balize these strategi es , si nee their appl i c-ati cxn o^nly depends on^ 



.an intcui.tilve feel as to how to use them^ If they are taught,. 



'ih^ey- are ijsually taugHt bry^xample. So tber%='i sT no' very specific . 
body of knowledge about the -Socratic me^thod^ and hence there^is 



no theory! to - be , extended and refined^- In fact untjl computers 
provided |us "with formal isijis for expressing "process models," 



}A. Js ._M.P Ll J.y_ _t h at. a n y o n e would have though t _.o f ' c o n s t r a g t i n.g a, 

specific theory aboul suth a thing as the. Sp.cr'a^^fc me.tho'd. 

. By making the tacit knowledge about ^S^crati c teachi ng 'expl i 

■cit, it becomes possible to educate teachers about the Socratic 

method. We can teach. them the stra.te-gies'^t'hat many d'ifferent' 

' ' ./ ■ . ■ 

teachers have devel oped ^li^d the situations where th,ey apply. If 

were to evolve the methJ|d pn their own ' o-f-.'' from watching other 

good teachers., they would .at best develop oaly a subset of these 



s tra teg i es * •« 

. . • _ ■ \ <u ' i 

■ More general ly the method of.-analysis can be-a-pplieci to 
analyze 'the speci f i c st rateg i es ' used by the .mos t,.e*f f ecti ve • 
teachef'T'tn-' the \:ountry. Sucyh an-- analys i s can be^derived from 
videotapes -of actual classes. Tt^- analysis would determine the 

•tea^cher's .-systematic patterns of "Response tb.'r, parti cul ar teaching 
Situations., It. is a. kind of formal analysis that si mply was/not 

""possible in terms of earlier formalispis in psychology, such as ■ 

S-R J)onds or stage ,model--s / Simply put we can now construct a 

formal theory of the strategies used by our mos± successful 
* ■/ • , * ■ . 

teachers, and we can thereby make -thei r accumulated tacit know-. 
l-G<Jge avai T a^bl e ' to every, p'otenti a-f 'teacher . 

My second example^ concerns model lin.g the l earner to' diag- 

'- / ' ..■.!■-_. 

pose his' mi sunderstaitdings . In a system called BUGGY, Brown & 
Burt<*n (1 978) developed a "representat^* on called a procedural net- 
wdnk- in which they- represent all the procedures :,assary to ' 
carryout '-addition aiid subtracti.on in exp'licit dc'c in &iJffGY,. 

procedural errors are represented as perturbations of the. • 
correct procedures. In this way -the program can simulate an.y 



-consi-s-tent- procedure that -s tudents f oi l ow even - i f - if i s -a wrong - 
procedure, as in the example below. 

Consider five "snap shots" of a student's performance do.ing 
addition a.s ' mj:^.^^^^^ s e e n on a ^homewor k ass i gnmen t . before .f^ro - 
ceedi ng., " di scover th^ student's bug. ^ . ^ 



San^ple'-of the student's work: 

f 



41 ^28 * 989 66 216 ' 

+ 9 +^17 . +£2 +^87 +1 3 

50 1345 ■ 1 1 41 1 053 229 ' , 

Once you have 'discovered the bug, try testing your hyp^Vhesis by 
"simiil ati ng" the buggy student so as to predict his resuT^s on 
the following two test problfems. ■ i ' 



■ 446 201 
■ ^ +81 5 +399 . " - 

; • . ^. ' ■ 

Th^^e bug is« real ly .quite simple. .In computer terms, the 
student^ after determi n i ng the carry, forgets to re-set the "carry 

' ■ ■ Cs,^ • ^ ■ ' ' J 

register^' to zero and^' hence the amount carried is accumulated 
across the- coJumns. For example, in the student l-s sfecond prob- 
lem,: (e-g., 328 + 917 ^uals 1 345) he proceeds as /o^ows: ^ ' 
8+7 '-15 s;^ -he writes -5 and carries '1, 2 + 1'= 3 plus the c^ne • 
carry is 4,\^st-iy 3 + 9 = 12'but that -one carry Prom the first 
column is still there i.t h-asn't been reset -- so .adding it 
in to . th^S' col umn gives 13.^ If this is the bug , then,, the answers 
. to 'the test probl ems^ will be 136i' ■and_ 700. This bug is not so. 
absurd when one ^p^nsi ders that, a . chi 1 d might use his fingers to • 

A • remember the carry and forget to bend back. his fingers, or 

'. ■ . ^ ' 

counters, after e.ach carry a-dded. 4, . 

ERIC - . 5 ^ . . ' 



:..;I t_.turns.. ou t ..that, i t . i.s. .ve ry-.-d.i.f fJ cult. ■ .f^ ^g.-::^.. 

nose systematic errors that -BUGGY makes ,"^5 pe.ci ally whe'n the er- ' 
rors are in low level . procedures that are called by different 
high level procedures, or when there is more than 'one bug jn dif- 

. • • • y ' • ■ 

ferent proceduVes^ To a teache r^-fhe students- errors are '1 i kely 



tolookrandom. 

Ojt^swy the BUGGY program can be used is to train, teachers 

and stucTent^ how to, diagno'se bugs. The program selects a b.ug, 

and gives' a few examples of the bug as manifested in working 
'• .■ ■ ... ) ' 

"problems. The user then^selects problems for BUGGY to. work 

until he thinks he has figured out the bug. Then BUGGY presents 

h'im with 'five test oases where he m^^st simulate the bug. If the 

user cannot producej the same _^swer as BUGGY on any of the~.tq3t 

cases he then goes ^back to tryin^g to dia-gnose^hy bug. this - 

^' • way teachers can be -taught how to be experWsl^gTiosti ci arts.. 

^ ' More importantly Brown S Burton ha>ve _used*BUGGy to analyze 
/ automarically a subtraction test taken by 1 300 students in th^ . 

Ath^^o 6th grades. They found that about^ 40% of the students 

•■ . ' , \- , . ■ ' . ■ ' ■ ■ 

used essentially correct procedures, about "20% have what a:ppear . 

. ^ ^ • ^ * 

■ to- be ra^^m errors to BUGGY, and about 40% have systematic pro- 

cedural errors. From their data they have compiled a list of the 

2*0 most frequent, errors in subtraction and their frequencies 

amo-ng grade school students. The thVee most common bugs are the 

\ . _ /» . 

jrol 1 owing : ' \ • . 

1- Borrow from zero (e.g., 103-45'= 158) Frequency 107/1300 

*■ Is - 

When borrowing from a coTumn whose top digit is 0, the - . 

Student writes 9, but does not continue borrowing from the 

column to the left-of the 6.' ' ^v' 



vERJC 



( ■ ^ ■ . 

2. Smaller from lai^ger (e.g., 253-1 1 8 ' = , 1 45 ) " Ffequ.ency 54/1300 
-The s t ud en t : s u bt r a c t s t he- -sma Vi e r - d i g 



larger digit rij^gardless of which" one 



t' i n . a c 0 1 umn -f rem t h e 
s on top. . 

3. Differenc'e of 0-N = N and jump over zero--in borrowi'ng 

(e.g., 2a4-25 = 1 29 ) ' Frequency= 34/ 1 300 ' . . 

When ever the top digit i,p a column is.O, the student writes 

the .bottom digit" in the^answer; i.e., 0-N = N. Wher^he 

student needs to borrc -oflT a column whose top digit* is 

0,' he skips thai column and borrows ' from the next one. 

The implications df BUGGY for testi ng ■ are , prof ound . No 

. . ■ . 

-longer' need a test be a means to assign a score to a .student. 

A score is an arbitrary measure that tel. Is vrry little about 

how well the student .^is doing or what his real r cblem is. For 

example, a single bug in a low leveT procedure will produce, 

many more wrong answers than several bugs in .igher level pni)- 

ceduVes. vWTiat a test becomes, if BUGGY is taKen seriously, is 

P • - ' ^ • 

a methoa for diagnosing the" students underlying errors. The 



outcome' IS a statement whatever specific procedural errors ' 
the student is making. ' Then teaching can be directed explicitly 
atthebugsthe test has diagnosed. - 

Su-fely befw^. BUGGY arithmetic had been stud i-ed . very thpr- 
oiTghly. ) But by applying a Cognitive Science analysis. Brown ' 
& Burton could find new insi-ghts into the problems children 
are' having^ Other basic skills {jjigher mathemat i cs , read i n-g , v' 
writing, etc.)^^i"e more difficult to artalyze in this way, but 

: the^lesson should be obvious . There is enormous lever*age-in 

- ■ ■ ■ ' . ^ ' / ^' 

this kind-of analysis and the potential implications for prac- 

^- • ■ . ' , . / , 

^ ' tical- education are .prof ound. v 

o^"^ - . . : * ■ . . ■ . 

■ ■ - ' ■ ' V / K . ' . ' 
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